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ABSTRACT: 

Recent  developments  in  computing  hardware  have  begun  to  make  mobile  and  wearable  Augmented 
Reality  (AR)  systems  a  reality.  With  this  new  freedom,  AR  systems  can  now  be  used  in  a  very  wide 
range  of  applications  including  disaster  relief,  localization  and  repair  of  utilities  and  even  as  an  assis¬ 
tant  for  tourists  walking  through  unfamiliar  historical  sites.  This  paper  considers  the  use  of  AR  to  as¬ 
sist  with  the  task  of  warfighting  in  an  urban  environment.  Urban  environments  are  compact,  compli¬ 
cated,  and  can  be  highly  dynamic.  Any  successful  AR  system  must  overcome  a  host  of  challenges  in¬ 
cluding  the  need  for  a  robust  tracking  systems  and  wearable  hardware  and  must  present  the  informa¬ 
tion  to  the  user  an  intuitive  and  informative  manner.  This  paper  considers  the  problem  of  designing  a 
user  interface  which  avoids  information  overload  through  automatically  managing  the  grahpical  con¬ 
text  which  is  displayed  to  the  user.  We  describe  the  paradigm  of  an  information  filter  -  a  decision 
mechanism  that  uses  the  user's  location,  the  user's  current  goal  and  the  properties  of  objects  within  the 
environment  to  deduce  what  information  should  be  displayed. 


1.  Introduction 

It  is  expected  that  many  future  military  op¬ 
erations  will  occur  in  urban  environments 
[CFMOUT-97].  These  present  many  unique 
and  challenging  conditions  for  the  warfighter. 
The  environment  is  extremely  complicated  and 
inherently  three-dimensional.  Above  street 
level,  buildings  serve  many  purposes  (such  as 
hospitals  or  communication  stations)  and  can 
harbor  many  risks  (such  as  snipers  or  mines) 
which  can  be  located  on  many  floors.  Below 
street  level,  there  can  be  a  complex  network  of 
sewers  and  tunnels.  The  environment  can  be 
very  cluttered.  Narrow  streets  restrict  line  of 
sight  and  make  it  difficult  to  plan  and  coordi¬ 
nate  group  activities.  The  environment  can  be 
highly  dynamic  and  in  constant  flux.  Threats 
(such  as  snipers)  can  continuously  move  and 
the  structure  of  the  environment  itself  can 
change.  For  example,  a  damaged  building  can 
fill  a  street  with  rubble,  making  a  once  safe 
route  impassable.  These  difficulties  are  com¬ 
pounded  by  the  need  to  minimize  the  number 


of  civilian  casualties  and  the  amount  of  damage 
to  civilian  targets. 

These  and  other  difficulties  have  lead  the 
Concepts  Division  of  the  Marine  Corps  Com¬ 
bat  Development  Command  to  conclude  that 

“Units  moving  in  or  between  zones  must  be 
able  to  navigate  effectively,  and  to  coordinate 
their  activities  with  units  in  other  zones,  as  well 
as  with  units  moving  outside  the  city.  This 
navigation  and  coordination  capability  must  be 
resident  at  the  very-small-unit  level,  perhaps 
even  with  the  individual  Marine”  [CFMOUT- 
97].  Therefore,  the  success  of  a  military  opera¬ 
tion  in  an  urbanized  environment  depends  cru¬ 
cially  on  being  able  to  provide  navigation  and 
coordination  information  at  the  individual  ma¬ 
rine  level. 

A  number  of  research  programs  have  ex¬ 
plored  the  means  by  which  navigation  and  co¬ 
ordination  information  can  be  delivered  to  the 
dismounted  soldier.  Many  of  these  approachs 
are  based  on  handheld  maps  (e.g.,  an  Apple 
Newton),  or  opaque  head  mounted  displays 
(HMD).  For  example,  the  Land  Warrior  pro¬ 
gram  introduced  a  headmounted  display  which 
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combined  a  map  and  a  “rolling  compass” 
[Gumm-98].  Unfortunately,  these  methods 
have  a  number  of  limitations.  They  obscure  the 
user’s  field  of  view  and  do  not  truly  represent 
the  three  dimensional  nature  of  the  environ¬ 
ment.  To  overcome  these  problems,  we  pro¬ 
pose  the  use  of  a  mobile  augmented  reality 
system. 

A  mobile  augmented  reality  system  consists 
of  a  computer,  a  tracking  system  and  a  see- 
through  head  mounted  display.  The  system 
tracks  the  position  and  orientation  of  the  user 
and  superimposes,  within  the  user’s  field  of 
view,  graphics  and  annotations  which  are 
aligned  with  objects  in  the  environment.  This 
approach  has  many  advantages.  Information 
can  be  presented  in  an  intuitive  manner  and 
integrated  directly  with  the  environment.  For 
example,  the  name  of  a  building  would  appear 
as  a  “virtual  sign  post”  attached  directly  to  the 
side  of  the  building.  To  explore  the  feasibility 
of  such  a  system,  the  Naval  Research  Labora¬ 
tory  (NRL)  is  developing  a  prototype  aug¬ 
mented  reality  system  known  as  BARS,  the 
Battlefield  Augmented  Reality  System.  This 
system  will  network  multiple,  outdoor,  mobile 
users  together  with  a  command  centre.  To 
achieve  this  goal  many  challenges  must  be 
overcome  [Julier-99].  These  include  hardware 
issues  (accurate  and  robust  tracking,  high  per¬ 
formance  head  mounted  displays  and  compact 
wearable  computers),  software  issues  (distrib¬ 
uted,  shared  three-dimensional  environments) 
and  human  computer  interaction  (what  infor¬ 
mation  should  be  displayed  and  how). 

This  paper  examines  the  proble  computer 
interaction  -  how  does  the  system  determine, 
from  the  user’s  context,  what  graphical  infor¬ 
mation  should  be  displayed?  This  is  extremely 
important  because  information  overload  is  a 
significant  potential  problem.As  a  user  moves 
through  the  environment,  their  context  can 
change  dramatically  depending  on  their  posi¬ 
tion  and  current  intent.  The  amount  of  in¬ 
formation  that  can  be  shown  to  a  user  in  a  vir¬ 
tual  world  can  be  overwhelming.  To  alleviate 
this  problem,  the  mobile  system  must  sort  and 
prioritize  information  so  that  only  the  features 
which  are  “most  relevant”  to  the  user’s  current 
state  and  location  should  be  shown.  In  this  pa¬ 
per,  we  argue  that  this  is  best  achieved  through 


an  'intelligent'  filter  which  determines  what  in¬ 
formation  is  relevant  to  the  user  at  a  particular 
time.  However,  the  design  of  such  a  system 
cannot  be  addressed  separately  from  the  model 
of  the  environment  which  is  maintained  by  the 
system. 

The  structure  of  this  paper  is  as  follows. 
Section  2  summarises  the  database  structure 
used  in  the  Battlefield  Augmented  Reality  Sys¬ 
tem  (BARS).  The  information  filter  is  de¬ 
scribed  in  Section  3.  The  BARS  prototype  is 
briefly  described  in  Section  4  and  future  work 
described  in  Section  5.  Conclusions  are  drawn 
in  Section  6. 

2.  The  BARS  Database 

2.1  Object  Model  of  the  Environment 

The  focus  of  BARS  is  to  deliver  information 
to  a  dismounted  warfighter  operating  in  an  ur¬ 
ban  environment.  The  system  has  to  potentially 
provide  information  about  very  fine-grained 
features  such  as  a  particular  door  in  a  particu¬ 
lar  building.  Therefore,  the  database  was  de¬ 
signed  to  be  object-oriented.  The  environment 
is  assumed  to  be  populated  by  large  numbers 
of  objects  which  have  certain  logical  and 
physical  relationships  between  one  another.  All 
objects  share  the  following  properties: 

•  name 

•  position 

•  type 

•  importance  vector.  This  vector  is  described 
in  more  detail  in  Section  3.3.2 

The  top  of  the  hierarchy  is  the  City  which 
defines  the  region  within  which  the  user  is  op¬ 
erating.  The  City  possesses  a  number  of  Forces 
(mobile  objects  which  can  be  enemies  or 
friends)  and  a  set  of  “regions”.  Each  “region” 
corresponds  to  a  feature  such  as  a  building  or  a 
street  and  has  the  property  that  it  contains  dis¬ 
crete  features  which  are  physically  grouped 
together.  Building  objects,  for  example,  pos¬ 
sess  walls,  windows  and  doors. 

2.2  Databases 

The  database  must  be  sufficiently  expressive 
that  it  can  be  used  to  render  a  scene  with  a 
high  degree  of  accuracy,  or  to  represent  it  as  a 
set  of  individual  components  which  can  be 
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shown  separately.  Furthermore,  the  distribu¬ 
tion  of  the  databases  must  be  such  that  individ¬ 
ual  mobile  clients  will  operate  even  if  the  con¬ 
nection  with  the  base  station  is  disrupted.  To 
achieve  these  goals,  the  system  actually  uses 
three  different  types  of  databases  which  are 
linked  to  one  another  -  the  Object  Database, 
the  Visual  Database  and  the  User  Database. 
The  Object  Database  contains  all  of  the  infor¬ 
mation  known  about  the  urban  environment  in 
a  symbolic  form;  for  instance,  the  names  of 
buildings  and  locations  of  snipers.  The  Visual 
Database  contains  the  geometrical/visual  data 
(textures  and  polygons)  necessary  to  visualize 
the  environment.  The  third  database  is  the  Us¬ 
ers'  Database;  it  contains  the  information  that 
is  displayed  on  the  users'  HMD  (e.g.,  military 
icons  or  names  of  buildings).  The  current  sys¬ 
tem,  which  consists  of  a  single  mobile  user, 
merges  the  Object  and  User  Database  together. 

3.  Information  Filtering 


3.1  Where  filtering  occurs 


The  filtering  performed  by  BARS  will  ensure 
that  only  the  most  relevant  information  is  dis¬ 
played  to  the  user  at  a  particular  time.  As  illus¬ 
trated  in  Figure  1,  the  filter  regulates  the  flow 
of  information  from  the  Object  to  the  User  da¬ 
tabase.  The  filter  regularly  checks  the  database 
and,  from  the  current  user  state  (position  and 
intent),  it  selects  a  set  of  objects  which  are 
passed  to  the  User  Database. 


Object 

Database 


I 

FILTER 

-uses info  in  Object 
DB  and  selects 
graphical  icons 


I 


User 

Database 


Feedback  from  user 


Displayed  on 
User’s  HMD 
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Figure  1:  The  Intelligent  Filter  fits  in-between 
the  Object  Database  and  the  User  Database. 


3.2  Displayed  to  user  on  the  Helmet 

The  aim  of  the  intelligent  filter  is  to  provide 
the  graphics  system  with  a  list  objects  of  that  it 
should  show  the  user  upon  his  HMD.  The  first 
step  in  this  process  is  to  determine  what  the 
user  can  'see'.  Then,  from  this,  determine  what 
is  relevant  to  the  user  based  on  their  goal  or 
mission.  In  the  BARS  system,  there  are  six 
possible  goals: 

•  FULL-ATTACK:  Full  attack  on  a  particu¬ 
lar  target,  such  as  a  building  or  an  enemy 
military  installation. 

•  STRATEGIC-ATTACK:  Strategic  move¬ 
ment  of  troops  towards  a  better  strategic 
position  in  the  urban  environment.  The  at¬ 
tack  is  not  centralized  to  a  single  enemy  as¬ 
set  but  looks  for  a  better  strategic  situation 
for  future  operations. 

•  ROUTE:  The  mission  of  the  user  is  to  go 
from  point  A  to  point  B  in  the  urban  envi¬ 
ronment  in  the  shortest  time  possible.  In  a 
friendly  environment  such  a  route  would  be 
the  most  direct  path,  but  in  a  combat  sce¬ 
nario,  it  takes  into  account  the  position  of 
enemy  units,  and  zones  where  an  enemy 
ambush  is  likely  to  take  place.  The  route 
needs  to  be  updated  dynamically  in  real¬ 
time  to  reflect  the  user's  current  position 
and  when  new  information  on  snipers  is  re¬ 
ceived,  for  example. 

•  STEALTH:  The  mission  is  to  perform 
clandestine  operations  behind  the  enemy 
lines.  These  type  of  missions  include  intel¬ 
ligence  gathering,  sabotague,  hostage  res¬ 
cue  and  indirect  assault  on  enemy  assets. 

•  RECON:  The  mission  is  to  perform  recon¬ 
naissance  on  a  determined  area  of  the  ur¬ 
ban  environment.  In  this  goal,  the  recon¬ 
naissance  can  be  done  on  important  mili¬ 
tary  targets,  such  as  military  installations, 
arms  caches,  targets  of  tactical  advantage 
and  etc.  Of  importance  for  this  mission  are 
installations  where  civilians  may  have  gath¬ 
ered,  food  stores  and  water  deposits. 

•  FULL-RECON:  The  mission  is  to  perform 
a  more  deep  reconnaissance  on  a  deter¬ 
mined  area  of  the  urban  environment.  Be¬ 
sides  concentrating  on  military  and  tactical 
targets  done  in  RECON,  FULL-RECON 
also  takes  into  account  civilian  instaila- 
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tions,  and  almost  any  other  kind  of  build¬ 
ing. 

The  filter  employs  a  “two  pass”  mechanism 
to  decide  what  information  should  be  shown. 

•  The  first  mechanism  is  a  physical  one  that 
only  shows  information  that  is  ‘close’  to 
the  user’s  current  location. 

•  The  second  mechanism  is  logical  or  ‘intel¬ 
ligent’  one  that  only  shows  information  to 
the  user,  which  is  ‘relevant’  to  them. 

3.3  Physical  constraint 

3.3.1  User’s  area  of  interest 

The  first  step  in  this  physical  constraint  is  to 
determine  the  user’s  physical  area  of  interest. 
This  is  the  area  that  the  user  focuses  upon. 
The  user’s  current  position  is  known  at  all 
times  through  the  GPS/GLONASS1  tracking 
system.  The  range  that  the  user  can  see  is  de¬ 
termined  by  their  goal.  The  following  criterion 
is  used,  based  upon  the  current  goal: 

•  ROUTE  -  range  is  straight-line  distance  to 
the  destination, 

•  RECON  -  medium  level 

•  FULL-RECON  -  medium  level, 

•  STEALTH  -  medium  level 

•  STRATEGIC-ATTACK  -  low  level 

•  FULL- ATTACK  -  low  level. 

This  range  can  be  overridden  by  the  user  at  any 
time. 

Given  a  range,  a  3D  volume  of  area  can  be 
determined  centered  around  the  user’s  posi¬ 
tion.  For  convenience  a  cube  is  used. 

In  the  real-world,  visual  information  is  in¬ 
hibited  by  real-world  limitations  such  as  walls. 
However,  for  the  user  in  BARS,  this  is  not  a 
problem;  BARS  can  provide  “X-Ray”  vision  of 
the  urban  environment  (based  on  available  in¬ 
formation  in  the  database).  This  clearly  high¬ 
lights  an  additional  advantage  of  the  BARS 
system.  Physical  barriers  do  not  limit  informa¬ 
tion  shown  to  the  user 

As  a  result  of  these  considerations,  an  area 
of  interest  of  the  user  is  obtained. 

3.3.2  Object’s  region  of  Influence  (RI) 

Definition 


1  GLONASS  is  the  Russian  equivalent  of  the 
US  (NAVSTAR)  GPS  system. 


Every  object  in  the  environment  has  two 
cubes  defining  it: 

•  one  enclosing  the  object’s  actual  physical 
or  geometric  dimensions  and 

•  one  known  as  the  Region  of  Influence. 

To  illustrate  the  difference  between  the  two, 
consider  a  sniper.  The  geometric  box  would 
encompass  the  actual  sniper;  this  would  be  ex¬ 
tremely  useful  for  attacking  this  sniper. 

Based  on  database  information,  we  can  cre¬ 
ate  a  second  box,  known  as  the  Region  of  In¬ 
fluence,  centered  at  the  sniper’s  position.  In 
the  case  of  the  sniper,  the  range  of  this  box  is 
determined  by  the  lethality  range  of  the 
weapon  (plus  a  small  buffer)  that  the  sniper  is 
carrying.  Even  though  the  lethality  range  of 
the  sniper’s  weapon  would  be  the  same,  the 
box  surrounding  the  sniper  needs  to  move  with 
the  change  in  the  sniper’s  position. 

In  order  to  provide  this  information  to 
BARS,  we  have  developed  heuristics  based  on 
the  object’s  type  and  importance  to  define  a 
region  of  influence  around  an  object.  The  re¬ 
gion  of  influence  actually  defines  the  geo¬ 
graphical  zone  where  an  object  has  an  influ¬ 
ence  upon. 

Object  Type 

The  following  criteria  was  used  in  order  to 
calculate  the  Region  of  Influence  (RI)  of  an 
object  based  upon  its  type: 

•  If  an  object  contains  no  forces  (ie  moving 
objects),  then  its  region-of-influence  is 
equivalent  to  geometric  region 

•  Otherwise  if  object  is  a  force  and  is 

•  Slow  moving  (eg  sniper  or  ground 
troop),  then  its  RI  =  lethality  range  of 
weapon  plus  a  small  percentage  (eg 
10%)  or 

•  Fast  moving  (eg  tank  or  APC  troop), 
then  its  RI  =  lethality  range  of  weapon 
plus  a  large  percentage  (eg  20%). 

Importance  parameter 

The  second  aspect  to  consider  when  defining 
a  region  of  influence  around  an  object,  is  the 
importance  parameter  associated  with  each 
object.  In  certain  mission  or  goal,  some  ob¬ 
jects  will  be  important,  while  others  will  not 
be.  For  instance,  in  FULL-ATTACK  attack 
there  is  no  need  to  display  the  location  of  food 
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supplies.  In  order  to  incorporate  this  informa¬ 
tion,  each  object  has  an  importance  parameter 
associated  with  it. 

The  importance  parameter  endeavours  to 
capture  the  tactical  knowledge  of  the  objects  in 
relation  to  its  type,  position  and  the  goal  of  the 
user.  For  instance,  a  tall  building  provides  a 
strategic  advantage  to  the  side  that  owns  it,  so 
it  would  be  a  high  priority  under  the  Strategic 
Attack  mode;  this  is  because  it  is  a  well  known 
fact  that  it  is  very  difficult  for  any  kind  of  de¬ 
fensive  manouveuer  against  an  enemy  in  an 
elevated  position.  Thus  in  BARS  we  reflect 
this  information  by  ensuring  that  the  region  of 
influence  around  the  tall  building  is  large  as 
compared  to  that  for  a  shorter  building  (for  the 
Strategic  Attack  mode). 

In  the  present  prototype,  the  importance  pa¬ 
rameter  is  a  binary  vector  which  attempts  to 
represent  the  importance  on  an  object  by  ask¬ 
ing  some  of  the  following  questions: 

•  does  the  objects  contain  military  assets? 

•  is  the  object  or  the  zone  of  defensive  tacti¬ 
cal  disadvantage,  meaning  that  is  a  good 
place  for  an  enemy  ambush? 

•  is  the  object  of  offensive  tactical  advan¬ 
tage,  such  as  a  tall  building  ? 

Using  the  Importance  parameter,  the  Region  of 
Influence  of  a  particular  object  may  be  in¬ 
creased. 

Calculating  an  Object’s  RI 

Using  the  above  two  sets  of  criteria,  every 
object  in  the  environment  will  have  a  Region  of 
Influence.  This  RI  is  centered  at  the  object’s 
physical  location.  The  size  of  the  region  of 
influence  is  determined  using  the  object’s  type 
and  importance  vector,  as  well  as  the  user’s 
current  goal.  In  addition,  for  moving  forces, 
the  RI  moves  with  the  object.  Thus,  these  re¬ 
gions  in  particular,  need  to  be  calculated  in 
real-time  in  order  to  warn  the  user  of  possible 
danger.  Figure  2  shows  typical  RI  for  some 
objects. 

3.3.3  List  of  objects  that  the  user  can  ‘see’ 

Given  the  user’s  area  of  interest  and  the  re- 
gion-of-influence  of  every  object  in  the  envi¬ 
ronment,  a  search  can  now  be  made.  If  an  ob¬ 
ject’s  region-of- influence  intersects  with  the 
user’s  area  of  interest,  then  that  object  may  be 


relevant  to  the  user;  see  Figure  3.  The  result 
of  this  search  is  that  a  list  of  objects  that  inter¬ 
sect  the  user’s  area  of  interest  is  found. 

However,  this  search  has  only  considered  the 
physical  aspects  of  the  user  and  the  objects. 
This  is  because  this  search  is  based  upon  the 
user’s  area  of  interest  and  an  object’s  region  of 
influence.  The  next  step  involves  determining 
whether  the  objects  on  this  list  should  be  dis¬ 
played  to  the  user. 


Troop 

lank 


Sniper 


Figure  2:Regions  of  influence  around  particular 
objects. 


Figure  3:  The  user’s  area  of  interest  intersect¬ 
ing  some  objects’  region  of  influence. 

3.4  Logical  constraint 

3.4.1  Strategy 

The  above  technique  of  the  physical  con¬ 
straints  resulted  in  a  list  of  potentially  relevant 
objects  being  determined.  This  section  de- 
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scribes  a  further  refinement  to  this  list  so  that 
only  relevant  objects  are  kept  and  displayed  to 
the  user.  There  are  certain  objects  that  need  to 
be  displayed  to  the  user,  regardless  of  the  goal 
or  their  importance.  These  are  discussed  in  the 
next  section.  Objects  selected  according  to  the 
current  goal  are  discussed  next. 

3.4.2  High  priority  objects 

There  are  objects  that  are  always  displayed  on 
the  user’s  HMD,  regardless  of  the  goal.  These 
items  are  objects  that  are  enemy  controlled. 

3.4.3  Objects  relevant  to  goals. 

In  order  to  determine  which  objects  to  dis¬ 
play  to  the  user,  the  importance  parameter  is 
once  again  used  to  ensure  that  certain  objects 
are  displayed  in  certain  modes.  For  instance, 
in  an  FULL-ATTACK  mode,  all  friendly  con¬ 
trolled  objects  are  shown. 

Besides  determining  which  objects  to  show, 
this  criterion  also  reflects  which  objects  not  to 
show.  Using  this  closed-world  assumption,  the 
resulting  list  is  tailored  to  the  user’s  current 
situation.  As  illustrated  in  Figure  4,  even 
though  two  objects  were  found  to  intersect  the 
user’s  area  of  interest,  only  one  was  kept. 

3.5  Overall  technique 

In  order  to  determine  the  lists  of  objects  to 
show  a  user  at  a  particular  time,  both  physical 
and  logical  constraints  are  used.  The  main 
steps  for  determining  which  objects  should  be 
shown  to  the  user  are  listed  below,  in  Figure  5 . 
This  algorithm  lists  the  main  steps  used  by  the 
filter  in  order  to  determine  which  objects  it 
should  display  to  the  user. 

3.6  Timing  of  filter 

The  filter  is  the  mechanism  used  in  order  to 
determine  a  list  of  objects  or  single  object  that 
should  be  shown  to  the  user  in  the  BARS  pro¬ 
totype.  The  question  now  to  ask  is  when 
should  the  filter  be  called. 

The  timing  of  the  filter  is  based  on  an  event- 
based  loop.  A  full  re-assessment  of  the  current 
situation  is  performed  when 

•  a  new  Goal  is  entered  into  the  system  or 

•  the  user’s  region  of  interest  changes  (e.g., 
because  the  user  has  moved  a  prespecified 
distance  d  since  the  last  filtering  step)  or 


•  a  timeout  event  has  occurred  (the  time 
since  the  last  update  exceeds  some  speci¬ 
fied  threshold  t). 

A  more  focussed  filter  is  called  when  an  object 
in  the  environment  is  added,  deleted  or  modi¬ 
fied  in  the  Object  Database.  In  this  situation, 
only  the  effect  of  one  particular  object  is 
gauged  against  the  current  objects  shown  to 
the  user. 

4.  BARS  Prototype 

The  BARS’s  hardware  is  illustrated  in  Fig¬ 
ure  6  and  is  composed  of  the  following  off-the- 
shelf  components: 

•  an  Ashtech  GG24-Surveyor  (GPS  receiver 
for  position-  only  tracking), 

•  an  InterSense  IS300Pro  (for  orientation- 
only  tracking), 

•  a  Sony  Glasstron  Head-Mounted  Display 
(HMD), 

•  a  Dell  Inspiron  7000  Notebook  computer 
(main  CPU  and  graphics  engine)  and 

•  a  FreeWave  Radio  Modem  (currently  used 
just  to  broadcast  GPS  differential  correc¬ 
tions). 

The  software  is  implemented  using  Java  JDK 
1.2  (for  high  level  object  management)  and  C 
(for  high  performance  graphics  rendering). 


Figure  4:  Eliminating  an  object  from  the  list 
whose  importance  is  not  relevant  in  the  current 
mode. 
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Calculate  the  region  of  interest  for  the  user. 
Calculate  the  Re gion-of -influence  (RI)  for  all 
the  objects  in  the  environment 

•  calculate  base  RI  using  object  type 

•  extend  RI  using  Importance  parameter 
Determine  objects  whose  RI  intersect  User’s 
area  of  interest 

Select  objects  that  are  relevant  to  the  goal  us¬ 
ing  logical  constraints 

•  select  all  enemy  controlled  objects 

•  select  all  objects  pertinet  to  goal  using  the 
Importance  Parameter  plus  other  consid¬ 
erations;  keep  or  remove  objects  as  neces¬ 
sary. 

LIST  OF  OBJECTS  TO  BE  SHOWN  TO 

USER _ 

Figure  5 :  Main  steps  used  by  the  filter. 


5.  Current  Success  and  Future  work 

Figure  6:  l  in  its  early  stages. 

pa  pc  c,,o  [g  the  idea  behind 
the  Importance  Parameter  and  the  structure  of 
the  Object  Database.  In  addition,  adding  real¬ 
istic  military  knowledge  to  the  possible  mis¬ 
sions  and  the  activities  during  those  missions 
would  enhance  the  realism  of  the  system. 

The  filter  itself  represents  the  first  step  in  an 
effort  to  develop  an  intelligent  and  autono¬ 
mous  Graphical  Information  Management  Sys¬ 
tem  (GIMS)  which  will  provide  information  in 
a  hands-off  manner  to  the  user.  The  full  GIMS 
capability  extends  the  filter’s  concept  of  what 
should  and  should  not  be  displayed  by  adding 
the  extra  dimension  of  determing  how  an  ob¬ 
ject  should  be  displayed.  For  example,  “high 
priority”  objects  might  require  a  different  pres¬ 
entation  style  (e.g.,  through  a  different  colour 
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and/or  the  use  of  a  supplemental  figure  audible 
cue  such  as  an  alarm). 

6.  Conclusions 

This  paper  has  described  the  Filtering 
mechnanism  used  by  the  Battlefield  Aug¬ 
mented  Reality  System  (BARS).  The  filter 
system  dictates  what  should  be  shown  to  the 
user  and  when.  It  thus  reduces  the  amount  of 
possible  information  that  the  user  in  the  field 
could  possibly  see,  superimposed  upon  the 
real-world.  In  addition,  the  filter  focuses  the 
attention  for  the  user.  The  filter  can  be 
thought  of,  as  a  data  management  system 
which  takes  in  data  at  one  end  and  send  only 
relevant  information  through  to  the  other  end. 

REFERENCES 

[CFMOUT-97] 

Concepts  Division,  Marine  Corps  Combat 
Development  Command,  “A  Concept  for 
Future 

Military  Operations  on  Urbanized  Terrain,” 
approved  July  1997 
[Gumm-98] 

M.M.Gumm,  W.P.  Marshakm  T.A. 
Branscome,  M.Mc  Wesler,  D.J.  Patton  and 
L.L.  Mullins,  “A  comparison  of  Solider 
Performance  using  current  Land  Naviga¬ 
tion  Equipment  with  Information  inte¬ 
grated  on  a  Helmet-Mounted  Display,  ARL 
Report  ARL-TR-1604,  DTIC  Report 
19980527081,  April  1998. 

[Julier-99] 

S.  Julier,  S.  Feiner  and  L.  Rosenblum, 
“Augmented  Reality  as  an  Example  of  a 
Demanding  Human-Centered  System”, 
First  EC/NSF  Advanced  Research  Work¬ 
shop,  1-4  June  1999,  France. 


8 


